Evaluation of an outreach programme for patients with COVID-19 in an integrated healthcare delivery system: a retrospective cohort study.

OBJECTIVES: In the first year of the COVID-19 pandemic, health systems implemented programmes to manage outpatients with COVID-19. The goal was to expedite patients' referral to acute care and prevent overcrowding of medical centres. We sought to evaluate the impact of such a programme, the COVID-19 Home Care Team (CHCT) programme. DESIGN: Retrospective cohort. SETTING: Kaiser Permanente Northern California. PARTICIPANTS: Adult members before COVID-19 vaccine availability (1 February 2020-31 January 2021) with positive SARS-CoV-2 tests. INTERVENTION: Virtual programme to track and treat patients with 'CHCT programme'. OUTCOMES: The outcomes were (1) COVID-19-related emergency department visit, (2) COVID-19-related hospitalisation and (3) inpatient mortality or 30-day hospice referral. MEASURES: We estimated the average effect comparing patients who were and were not treated by CHCT. We estimated propensity scores using an ensemble super learner (random forest, XGBoost, generalised additive model and multivariate adaptive regression splines) and augmented inverse probability weighting. RESULTS: There were 98 585 patients with COVID-19. The majority were followed by CHCT (n=80 067, 81.2%). Patients followed by CHCT were older (mean age 43.9 vs 41.6 years, p<0.001) and more comorbid with COmorbidity Point Score, V.2, score ≥65 (1.7% vs 1.1%, p<0.001). Unadjusted analyses showed more COVID-19-related emergency department visits (9.5% vs 8.5%, p<0.001) and hospitalisations (3.9% vs 3.2%, p<0.001) in patients followed by CHCT but lower inpatient death or 30-day hospice referral (0.3% vs 0.5%, p<0.001). After weighting, there were higher rates of COVID-19-related emergency department visits (estimated intervention effect -0.8%, 95% CI -1.4% to -0.3%) and hospitalisation (-0.5%, 95% CI -0.9% to -0.1%) but lower inpatient mortality or 30-day hospice referral (-0.5%, 95% CI -0.7% to -0.3%) in patients followed by CHCT. CONCLUSIONS: Despite CHCT following older patients with higher comorbidity burden, there appeared to be a protective effect. Patients followed by CHCT were more likely to present to acute care and less likely to die inpatient.

Training the next generation of delivery science researchers: 10-year experience of a post-doctoral research fellowship program within an integrated care system.

Introduction: Learning health systems require a workforce of researchers trained in the methods of identifying and overcoming barriers to effective, evidence-based care. Most existing postdoctoral training programs, such as NIH-funded postdoctoral T32 awards, support basic and epidemiological science with very limited focus on rigorous delivery science methods for improving care. In this report, we present the 10-year experience of developing and implementing a Delivery Science postdoctoral fellowship embedded within an integrated health care delivery system. Methods: In 2012, the Kaiser Permanente Northern California Division of Research designed and implemented a 2-year postdoctoral Delivery Science Fellowship research training program to foster research expertise in identifying and addressing barriers to evidence-based care within health care delivery systems. Results: Since 2014, 20 fellows have completed the program. Ten fellows had PhD-level scientific training, and 10 fellows had clinical doctorates (eg, MD, RN/PhD, PharmD). Fellowship alumni have graduated to faculty research positions at academic institutions (9), and research or clinical organizations (4). Seven alumni now hold positions in Kaiser Permanente's clinical operations or medical group (7). Conclusions: This delivery science fellowship program has succeeded in training graduates to address delivery science problems from both research and operational perspectives. In the next 10 years, additional goals of the program will be to expand its reach (eg, by developing joint research training models in collaboration with clinical fellowships) and strengthen mechanisms to support transition from fellowship to the workforce, especially for researchers from underrepresented groups.

Changes in COVID-19 Vaccine Intent Among a Diverse Population of Older Adults, June 2021-February 2022.

Introduction COVID-19 vaccination rates remain suboptimal in the United States. Clinicians and policymakers need to better understand how likely vaccine-hesitant individuals are to ultimately accept vaccination and what is associated with such changes. This study's aims were to 1) describe changes between vaccine intentions and actual uptake from June 2021 through February 2022, and 2) identify modifiable factors associated with vaccine uptake among those with initial hesitancy. Methods This cohort study included a stratified random sample of adults aged 65 years and older in an integrated health care system. The survey, conducted June through August 2021, elicited intent and perceptions regarding COVID-19 vaccination. Subsequent vaccine uptake through February 2022 was analyzed using electronic health records. Results Of 1195 individuals surveyed, 66% responded; 213 reported not yet having received a COVID-19 vaccine and were further analyzed. At baseline, most individuals said they would definitely not (42%) or probably not (5%) get the COVID-19 vaccine or were not sure (26%). During follow-up, 61 individuals (29%) were vaccinated, including 19% of those who initially said they would definitely not be vaccinated. Among vaccine-hesitant individuals, the rate of vaccination was highest for those who initially considered COVID-19 less dangerous than the vaccine (46%) or named short-term side effects (36%) as their most important concern. Conclusions COVID-19 vaccine intent among older adults was malleable during the pandemic's second year, even among those who initially said they would definitely not be vaccinated. Vaccine uptake could be enhanced by increasing awareness of COVID-19 risks and by addressing vaccine side effects.

Strategies Facilitating Video Visit Implementation by a Medical Group Serving a Diverse Population.

IntroductionVideo visits have created new opportunities to enhance access to care, but limited information exists on strategies medical groups can employ to facilitate video visit use by higher-risk patients. Our objective was to identify generalizable strategies to facilitate successful delivery of video visits by systems serving highly diverse patient populations. MethodsThe authors conducted a qualitative study of physicians and staff members in a large group practice with 4.5 million patients with diverse race and ethnicity and socioeconomic status. Semi-structured interviews were conducted between January 2021 and April 2021, with key informants identified via purposive and snowball sampling. Video-recorded interviews were transcribed and analyzed using thematic analysis to identify major themes and subthemes. ResultsThe 42 key informants included regional and medical center leaders, primary care physicians, service managers, and medical assistants. Participants described clinical leadership in technology and multidisciplinary collaboration as crucial to sustained video care adoption. Strategies to facilitate real-time learning included local innovation, rapid communication channels, and psychological safety. The organization offered broad access to frequently updated data reports to help managers and practitioners understand processes, measure performance, and share best practices. Medical assistants and physicians developed new approaches to empathize, tailor interactions with patients, and overcome psychological and technical barriers to connecting via video. ConclusionsKey strategies for sustained video care adoption included clinical leadership articulating its purpose, multidisciplinary collaboration, local innovation, effective data use, empathy, and personalized care. These findings provide a model for how health care systems can foster robust adoption of technologies to serve diverse populations.

Effect of Electronic and Mail Outreach From Primary Care Physicians for COVID-19 Vaccination of Black and Latino Older Adults: A Randomized Clinical Trial.

Importance: COVID-19 morbidity is highest in Black and Latino older adults. These racial and ethnic groups initially had lower vaccination uptake than others, and rates in Black adults continue to lag. Objectives: To evaluate the effect of outreach via electronic secure messages and mailings from primary care physicians (PCPs) on COVID-19 vaccination uptake among Black and Latino older adults and to compare the effects of culturally tailored and standard PCP messages. Design, Setting, and Participants: This randomized clinical trial was conducted from March 29 to May 20, 2021, with follow-up surveys through July 31, 2021. Latino and Black individuals aged 65 years and older from 4 Kaiser Permanente Northern California (KPNC) service areas were included. Data were analyzed from May 27, 2021, to September 28, 2021. Interventions: Individuals who had not received COVID-19 vaccination after previous outreach were randomized to electronic secure message and/or mail outreach from their PCP, similar outreach with additional culturally tailored content, or usual care. Outreach groups were sent a secure message or letter in their PCP's name, followed by a postcard to those still unvaccinated after 4 weeks. Main Outcomes and Measures: The primary outcome was time to receipt of COVID-19 vaccination during the 8 weeks after initial study outreach. KPNC data were supplemented with state data from external sources. Intervention effects were evaluated via proportional hazards regression. Results: Of 8287 included individuals (mean [SD] age, 72.6 [7.0] years; 4665 [56.3%] women), 2434 (29.4%) were Black, 3782 (45.6%) were Latino and preferred English-language communications, and 2071 (25.0%) were Latino and preferred Spanish-language communications; 2847 participants (34.4%) had a neighborhood deprivation index at the 75th percentile or higher. A total of 2767 participants were randomized to culturally tailored PCP outreach, 2747 participants were randomized to standard PCP outreach, and 2773 participants were randomized to usual care. Culturally tailored PCP outreach led to higher COVID-19 vaccination rates during follow-up compared with usual care (664 participants [24.0%] vs 603 participants [21.7%]; adjusted hazard ratio (aHR), 1.22; 95% CI, 1.09-1.37), as did standard PCP outreach (635 participants [23.1%]; aHR, 1.17; 95% CI, 1.04-1.31). Individuals who were Black (aHR, 1.19; 95% CI, 1.06-1.33), had high neighborhood deprivation (aHR, 1.17; 95% CI, 1.03-1.33), and had medium to high comorbidity scores (aHR, 1.19; 95% CI, 1.09-1.31) were more likely to be vaccinated during follow-up. Conclusions and Relevance: This randomized clinical trial found that PCP outreach using electronic and mailed messages increased COVID-19 vaccination rates among Black and Latino older adults. Trial Registration: ClinicalTrials.gov Identifier: NCT05096026.

Development of a healthcare system COVID Hotspotting Score in California: an observational study with prospective validation.

OBJECTIVE: To examine the value of health systems data as indicators of emerging COVID-19 activity. DESIGN: Observational study of health system indicators for the COVID Hotspotting Score (CHOTS) with prospective validation. SETTING AND PARTICIPANTS: An integrated healthcare delivery system in Northern California including 21 hospitals and 4.5 million members. MAIN OUTCOME MEASURES: The CHOTS incorporated 10 variables including four major (cough/cold calls, emails, new positive COVID-19 tests, COVID-19 hospital census) and six minor (COVID-19 calls, respiratory infection and COVID-19 routine and urgent visits, and respiratory viral testing) indicators assessed with change point detection and slope metrics. We quantified cross-correlations lagged by 7-42 days between CHOTS and standardised COVID-19 hospital census using observational data from 1 April to 31 May 2020 and two waves of prospective data through 21 March 2021. RESULTS: Through 30 September 2020, peak cross-correlation between CHOTS and COVID-19 hospital census occurred with a 28-day lag at 0.78; at 42 days, the correlation was 0.69. Lagged correlation between medical centre CHOTS and their COVID-19 census was highest at 42 days for one facility (0.63), at 35 days for nine facilities (0.52-0.73), at 28 days for eight facilities (0.28-0.74) and at 14 days for two facilities (0.73-0.78). The strongest correlation for individual indicators was 0.94 (COVID-19 census) and 0.90 (new positive COVID-19 tests) lagged 1-14 days and 0.83 for COVID-19 calls and urgent clinic visits lagged 14-28 days. Cross-correlation was similar (0.73) with a 35-day lag using prospective validation from 1 October 2020 to 21 March 2021. CONCLUSIONS: Passively collected health system indicators were strongly correlated with forthcoming COVID-19 hospital census up to 6 weeks before three successive COVID-19 waves. These tools could inform communities, health systems and public health officials to identify, prepare for and mitigate emerging COVID-19 activity.

Racial Disparities in COVID-19 Testing and Outcomes : Retrospective Cohort Study in an Integrated Health System.

BACKGROUND: Racial disparities exist in outcomes after severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection. OBJECTIVE: To evaluate the contribution of race/ethnicity in SARS-CoV-2 testing, infection, and outcomes. DESIGN: Retrospective cohort study (1 February 2020 to 31 May 2020). SETTING: Integrated health care delivery system in Northern California. PARTICIPANTS: Adult health plan members. MEASUREMENTS: Age, sex, neighborhood deprivation index, comorbid conditions, acute physiology indices, and race/ethnicity; SARS-CoV-2 testing and incidence of positive test results; and hospitalization, illness severity, and mortality. RESULTS: Among 3 481 716 eligible members, 42.0% were White, 6.4% African American, 19.9% Hispanic, and 18.6% Asian; 13.0% were of other or unknown race. Of eligible members, 91 212 (2.6%) were tested for SARS-CoV-2 infection and 3686 had positive results (overall incidence, 105.9 per 100 000 persons; by racial group, White, 55.1; African American, 123.1; Hispanic, 219.6; Asian, 111.7; other/unknown, 79.3). African American persons had the highest unadjusted testing and mortality rates, White persons had the lowest testing rates, and those with other or unknown race had the lowest mortality rates. Compared with White persons, adjusted testing rates among non-White persons were marginally higher, but infection rates were significantly higher; adjusted odds ratios [aORs] for African American persons, Hispanic persons, Asian persons, and persons of other/unknown race were 2.01 (95% CI, 1.75 to 2.31), 3.93 (CI, 3.59 to 4.30), 2.19 (CI, 1.98 to 2.42), and 1.57 (CI, 1.38 to 1.78), respectively. Geographic analyses showed that infections clustered in areas with higher proportions of non-White persons. Compared with White persons, adjusted hospitalization rates for African American persons, Hispanic persons, Asian persons, and persons of other/unknown race were 1.47 (CI, 1.03 to 2.09), 1.42 (CI, 1.11 to 1.82), 1.47 (CI, 1.13 to 1.92), and 1.03 (CI, 0.72 to 1.46), respectively. Adjusted analyses showed no racial differences in inpatient mortality or total mortality during the study period. For testing, comorbid conditions made the greatest relative contribution to model explanatory power (77.9%); race only accounted for 8.1%. Likelihood of infection was largely due to race (80.3%). For other outcomes, age was most important; race only contributed 4.5% for hospitalization, 12.8% for admission illness severity, 2.3% for in-hospital death, and 0.4% for any death. LIMITATION: The study involved an insured population in a highly integrated health system. CONCLUSION: Race was the most important predictor of SARS-CoV-2 infection. After infection, race was associated with increased hospitalization risk but not mortality. PRIMARY FUNDING SOURCE: The Permanente Medical Group, Inc.

Evaluation of Attention Switching and Duration of Electronic Inbox Work Among Primary Care Physicians.

Importance: Primary care physicians (PCPs) report multitasking during workdays while processing electronic inbox messages, but scant systematic information exists on attention switching and its correlates in the health care setting. Objectives: To describe PCPs' frequency of attention switching associated with electronic inbox work, identify potentially modifiable factors associated with attention switching and inbox work duration, and compare the relative association of attention switching and other factors with inbox work duration. Design, Setting, and Participants: This cross-sectional study of the work of 1275 PCPs in an integrated group serving 4.5 million patients used electronic health record (EHR) access logs from March 1 to 31, 2018, to evaluate PCPs' frequency of attention switching. Statistical analysis was performed from October 15, 2018, to August 28, 2020. Main Outcomes and Measures: Attention switching was defined as switching between the electronic inbox, other EHR work, and non-EHR periods. Inbox work duration included minutes spent on electronic inbox message views and related EHR tasks. Multivariable models controlled for the exposures. Results: The 1275 PCPs studied (721 women [56.5%]; mean [SD] age, 45.9 [8.5] years) had a mean (SD) of 9.0 (7.6) years of experience with the medical group and received a mean (SD) of 332.6 (148.3) (interquartile range, 252-418) new inbox messages weekly. On workdays, PCPs made a mean (SD) of 79.4 (21.8) attention switches associated with inbox work and did a mean (SD) 64.2 (18.7) minutes of inbox work over the course of 24 hours on workdays. In the model for attention switching, each additional patient secure message beyond the reference value was associated with 0.289 (95% CI, 0.217-0.362) additional switches, each additional results message was associated with 0.203 (95% CI, 0.127-0.278) additional switches, each additional request message was associated with 0.190 (95% CI, 0.124-0.257) additional switches, and each additional administrative message was associated with 0.262 (95% CI, 0.166-0.358) additional switches. Having a panel (a list of patients assigned to a primary care team) with more elderly patients (0.144 switches per percentage increase [95% CI, 0.009-0.278]) and higher inbox work duration (0.468 switches per additional minute of inbox work [95% CI, 0.411-0.524]) were also associated with higher attention switching involving the inbox. In the model for inbox work duration, each additional patient secure message beyond the reference value was associated with 0.151 (95% CI, 0.085-0.217) additional minutes, each additional results message was associated with 0.338 (95% CI, 0.272-0.404) additional minutes, each additional request message was associated with 0.101 (95% CI, 0.041-0.161) additional minutes, and each additional administrative message was associated with 0.179 (95% CI, 0.093-0.265) additional minutes. A higher percentage of the panel's patients initiating messages (0.386 minutes per percentage increase [95% CI, 0.026-0.745]) and attention switches (0.373 minutes per switch [95% CI, 0.328-0.419]) were also associated with higher inbox work duration. In addition, working at a medical center where all PCPs had high inbox work duration was independently associated with high or low inbox work duration. Conclusions and Relevance: This study suggests that PCPs make frequent attention switches during workdays while processing electronic inbox messages. Message quantity was associated with both attention switching and inbox work duration. Physician and patient panel characteristics had less association with attention switching and inbox work duration. Assisting PCPs with message quantity might help modulate both attention switching and inbox work duration.